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ANALYSIS OF CELL MORPHOLOGY AND MOTILITY 

The present invention relates to a method and 
apparatus for analysing cell morphology and motility. It 
5 is particularly, but not necessarily exclusively, 
concerned with the analysis of the morphology and 
motility of spermatozoa, for example in male fertility 
investigations . 

The analysis of human semen is currently a time 

10 consuming process that is prone to errors (Matson, 1995) . 
Furthermore, it is difficult adequately to quality 
control such analysis (Clements et al . , 1997) . The 
technique of semen analysis is agreed by an international 
advisory board and the agreed technique is published by 

15 the World Health Organisation as a laboratory manual . 

The current version of the relevant WHO laboratory manual 
was published in 1999 and outlines the various 
macroscopic and microscopic measurements that should be 
made during human semen analysis (WHO, 1999) . Whilst the 

20 macroscopic measures (for example seminal volume, pH, 

viscosity) are relatively straightforward, the three main 
microscopic measures (sperm concentration, sperm 
morphology and sperm motility) are performed in separate 
stages as explained below. 

25 Sperm concentration is normally estimated using a 

haemocytometer . Other counting chambers may be used, 
although these are often considered inaccurate by 
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comparison. To perform haemocytometry, sperm must be 
killed with fixative prior to counting. 

Sperm motility measurements are made on live sperm 
observed on a microscope slide (or specialist observation 
5 chamber) of at least 20fxm depth. Up to 200 sperm are 

classified into one of four motility grades to determine 
the proportion of motile sperm in the sample. 

Sperm morphology measurements (i.e. how many sperm 
are of the correct size and shape) are made on fixed, 

10 stained, killed sperm by smearing a small aliquot of 
semen onto a microscope slide and allowing it to dry 
before being fixed (using, e.g., methanol) and staining it 
with a histological stain (e.g. Papanicolau) . Note that 
the sperm are killed through the fixing and staining 

15 process. At least 100 of the sperm are then observed and 
classified as normal or abnormal, or an index of 
abnormality is calculated e.g. using the TZ1 index (WHO, 
1999) . 

In the majority of laboratories, the microscopic 
20 measures are made manually, with estimates of 

concentration and motility being made within an hour of 
ejaculation. However, measurements of sperm morphology 
can only be made once the smear has been stained and this 
may take several hours and can even be performed many 
25 days later. 

Manual measurement of motility is usually 
undertaken by a technician visually examining a live cell 
sample under a microscope, attempting to count the number 
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of motile cells in the field of view. This technique is 
unreliable as it is highly subjective, leading to 
different estimates of motility between different 
laboratories. Furthermore, the morphological. 
5 determination is then made at a different time on a fixed, 
killed and stained sample. 

To assist in these microscopic measurements, 
several manufacturers have developed and introduced into 
the market Computer Aided Sperm Analysers (CASA) . See, 

10 for example, reference Mortimer, 1994 for a review. 

These CASA machines can improve the accuracy of the 
microscopic measures, although three major problems with 
them have been identified. Firstly, they have difficulty 
in tracking sperm trajectories which cross or where two 

15 or more sperm collide. This leads to broken tracks, 
which in turn gives rise to inaccurate kinematic 
statistics and elevated measurements of sperm 
concentration. Secondly, they are only able to generate 
reliable motility measurements within a relatively narrow 

20 range of sperm concentrations, as at high concentrations 
immotile sperm are jostled leading to elevated estimates 
of sperm motility. Thirdly, separate software is 
required to undertake the analysis of fixed sperm samples 
to provide an estimate of sperm morphology. Moreover, 

25 most current software has difficulty identifying defects 
of the sperm tail. 

As a consequence of these drawbacks, and in 
addition to their relatively high purchase costs, CASA 
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machines are rarely used in routine laboratories but 
remain the preserve of research institutions or 
specialist fertility centres. 

The present inventors have realised that existing 
5 CASA machines fail to address a fundamental problem of 
semen analysis. This is that, to interpret the 
information from the microscopic measures, the clinician 
or researcher must assume that the motile sperm are 
morphologically normal, whereas in reality this is not 

10 always the case. The inventors have realised that it 
would be advantageous to provide a technique that can 
provide a single figure to determine the 'concentration 
of motile morphologically normal sperm' in an ejaculate 
and/or the frequency distribution of head parameters 

15 and/or kinematic data. 

GB-A-2130718 discloses an apparatus for measuring 
spermatozoal motility. However, this apparatus is only 
capable of calculating an average velocity for the cells 
in a sample. It does not allow for the tracking of 

20 individual cells. 

GB-A-2305723 discloses a cytological specimen 
analysis system. This system is analysing the morphology 
of killed cells. 

WO92/13308 discloses a morphological 

25 classification method for cells. A digital 

representation of the cells is obtained and filtered to 
identify malignant or premalignant cells. However, the 
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method is not carried out on live cells, so there can be 
no measurement of motility. 

US-A-4896967 discloses an apparatus for 
determining the motility if cells. Magnified images of 
5 live cells are captured using a video camera mounted on a 
microscope . The images are recorded for the purposes of 
motility analysis. There is no disclosure of 
morphological characterisation of the cells analysed. 

It is known from a variety of physiological 

10 studies that the ability of sperm to pass through 
cervical mucus is dependent both upon its motility 
(Aitken et al . , 1985; Mortimer et al . , 1986) and 
morphological (Katz et al . , 1990) characteristics. In 
addition, it has been suggested that only sperm with 

15 x normal' morphology are able to *bind' to the isthmic 
endosalpinx prior to fertilisation (Ellington et al . , 
1997) and subsequently bind to the zona pellucida of the 
egg (Liu & Baker, 1992) . Consequently, the inventors 
consider that the ability to a) measure the concentration 

20 of motile sperm with normal morphology in an ejaculate 
(or a prepared sperm sample) and b) to define the 
frequency distribution of kinematic parameters as a 
function of head dimensions, could be a major advance in 
our ability to define the functional population of sperm. 

25 This is increasingly important with growing concern about 
the possible effects on semen quality of environmental or 
occupational factors (Swan and Elkin, 1999) . 
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The present invention aims to address one or more 
of the above problems, preferably reducing, ameliorating 
or eliminating one or more of the above problems. 

In a first aspect, the invention provides a method 
5 for determining the morphology and motility of a 
population of cells in vitro including the steps: 

capturing a first frame of image data of said 
population and identifying a part or parts of the 
image data corresponding to a cell or cells of 
10 interest; 

capturing a second frame of image data of 
said population and identifying a part or parts of 
the image data corresponding to a cell or cells of 
interest; 

15 determining the morphology of the cell or 

cells of interest from the first and/or second 
frame; and 

determining the relative displacement, in the 
second frame compared to the first frame, of the 
20 cell or cells of interest. 

In this way, the inventors have found that it is 
possible to determine both the morphology and the 
motility of a population of cells. Known schemes, 
particularly those for analysis of semen samples, perform 
25 each test separately (the motility test being on a live 
sample, and the morphology test on a killed sample) . An 
advantage that may be provided by the present invention 
is that the number of motile, morphologically normal 
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cells, the frequency distribution of the head parameters 
and the kinematic properties can be determined in a 
single test. 

Preferred and/or optional features will now be set 
5 out. These are applicable independently or in any 

combination with any aspect of the invention, unless the 
context demands otherwise. 

Preferably, the first and second frames are 
adjacent frames in a series of more than two frames of 
10 image data captured of said population, the method 

further including, for each frame of said series, the 
steps : 

identifying a part or parts of said image 
data corresponding to the cell or cells of 
15 interest; and 

determining the relative displacement, in 
said frame compared to the' previous frame in said 
series, of the cell or cells of interest. 
Preferably, the method further including the step 
20 of determining the morphology of said cell or cells 
identified for each frame of said series. 

Preferably, the method allows simultaneous 
determination of morphology and motility. 

Preferably, the method includes the step of 
25 determining kinematic parameters for the motility of the 
cell or cells of interest, based on the relative 
displacement of the cell or cells of interest. Typically, 
the amount or relative amount of the population of cells 
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having a motility at or above a threshold motility value 
may be determined. 

Preferably, the method includes the step of 
classifying the cell or cells identified as 
5 morphologically normal or morphologically abnormal or 

making specific measurements of head size. Furthermore, 
the method may include the step of determining the amount 
or relative amount of the population of cells being 
morphologically normal . 

10 In particular, the method may include the step of 

determining the amount or relative amount of the 
population of cells being morphologically normal and 
having a motility at or above a threshold motility value 
or as a frequency distribution. 

15 Preferably, the method is for carrying out a first 

determination of morphology and motility on a first area 
of a sample of cells, the method including the step of 
carrying out a second and, optionally, further, 
determinations of morphology and motility on a second and, 

20 optionally, further, areas of the sample. In this way, 
the results from the method can be considered to be more 
representative than a test carried out on a single area 
alone. 

In preferred embodiments, the method is carried 
25 out with the aid of image processing devices, usually 
using a suitably programmed computer. Typically, the 
human eye will be not be able to make determinations of 
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morphology and motility with sufficient speed to provide 
reliable results. 

The inventors realise that it may be possible to 
capture a series of frames of image data from the 
5 population of cells and, in a separate process, determine 
the morphology and motility of those cells using the 
image data. This constitutes an independent aspect of 
the invention. 

Accordingly, in a second aspect, the invention 
10 provides a method of processing image data captured from 
a population of cells in vitro in order to determine the 
morphology and motility of the cells, the image data 
including 

a first frame of image data of said population and 
15 a second frame of image data of said population, the 
method including the steps: 

determining the morphology of the cell or 
cells of interest from the first and/or second 
frame; and 

20 determining the relative displacement, in the 

second frame compared to the first frame, of the 
cell or cells of interest. 

In the case where the morphological and motility 
determination is carried out on the image data separately 
25 from the capture of the image data, the image data may be 
stored in the intervening time on memory means, for 
example on the internal memory of a computer (ROM or RAM) 
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or on an external memory means such as a portable data 
carrier (e.g. CD or DVD) . 

Preferred and/or optional features will now be set 
out. These are applicable independently or in any 
5 combination with any aspect of the invention, unless the 
context demands otherwise. In particular, it is intended 
that these features are also applicable to the first 
aspect . 

Preferably, the first frame of image data is 
10 processed to identify illumination intensity 

distributions of interest having one of a plurality of 

characteristic profiles . 

As a first example, one of the characteristic 

profiles may be a first characteristic profile having a 
15 centre point of a relatively high intensity surrounded by 

a substantially symmetrical gradual reduction in 

intensity. It has been found that such a profile is 

consistent with the illumination profile of the nucleus 

portion of the head of spermatozoa. 
20 As a second example, one of the characteristic 

profiles is a second characteristic profile consistent 

with the illumination profile of the acrosome portion of 

the head of spermatozoa. 

As a third example, one of the characteristic 
25 profiles is a third characteristic profile consistent 

with the illumination profile of the acrosome portion of 

the head of spermatozoa. 



WO 2005/080944 PCT/GB2005/000558 

11 

Preferably, the parts of the image data 
corresponding to the illumination intensity distributions 
of interest are further processed to identify cell 
perimeter features surrounding one or more of said 
5 illumination intensity distributions of interest. By 
looking for cell perimeter features in this way, it is 
possible to identify cells of interest because they have 
at least one illumination profile corresponding to a 
feature of interest (e.g. DNA portion, acrosome portion 

10 and/or nose portion) and a cell perimeter portion 

surrounding said illumination profile (s) of interest. 

For example, the parts of the image data 
corresponding to the illumination intensity distributions 
of interest may be further processed to identify cell 

15 perimeter features surrounding an illumination intensity 
distribution having a characteristic profile with a 
centre point of a relatively high intensity surrounded by 
a substantially symmetrical gradual reduction in 
intensity. 

20 In the case where the perimeter of the cells of 

interest (e.g. spermatozoa) themselves have a distinctive 
shape, the method may further include the step of 
processing the parts of the image data corresponding to 
the illumination intensity distributions of interest to 

25 identify cell perimeters of a characteristic shape. 

Preferably, once an object of interest is 
identified, the method further includes the step of 
determining one or more dimensions or relative dimensions 
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of the object. Said dimensions or relative dimensions 
may be compared to one or more predetermined ranges of 
corresponding dimensions or relative dimensions. For 
example, a look-up table may be used, the look-up table 
5 containing the predetermined ranges of dimensions or 

relative dimensions corresponding to cells of interest. 

Preferably, the method further includes the step 
of determining whether said object is a cell to be 
tracked or not and, if said object is a cell to be 

10 tracked, assigning a tracking identity to it; or, if said 
object is not a cell to be tracked, assigning a residual 
object identity to it. In this way, substantially all of 
the objects identified in the image processing of the 
image data can have an identity assigned so that the same 

15 objects can be correctly identified in subsequent frames 
of image data . 

Preferably, the method further includes the step 
of determining a characteristic morphological value for a 
cell to be tracked. 

20 Typically, the method is repeated in order to 

identify all cells to be tracked and all objects not to 
be tracked in a frame of image data. Furthermore, this 
method may be repeated for the second and/or subsequent 
frames . 

25 Having determined a characteristic morphology for 

the cells to be tracked, we can now look at how the cells 
may be tracked. Preferably, the method further includes 
tracking the cells by identifying said cells and their 
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locations in the second and/or subsequent frames of image 
data. Typically, the tracking is carried out by 
collating the relative displacements of the locations of 
the cells through the sequence of frames of image data. 
5 In the case where the tracks of two cells of 

interest intersect, the cells and their tracks are 
preferably identified before and after the intersection 
by their characteristic morphologies. 

In the case where a cell of interest is identified 

10 in one frame and is not identified in the next frame, the 
cell then being identified in a subsequent frame, the 
method preferably further includes calculating tracking 
data to connect the track of the cell through said frames. 

Preferably, the method further includes the step 

15 of determining a motility characteristic for a tracked 
cell . 

The method may in particular include the 
determination of an overall figure of merit for the 
sample indicative of the number or proportion of 
20 morphologically normal cells with normal motility. 

Additionally or alternatively, the method may 
include the step of processing data relating to motility 
and/or morphology of the cells identified in the 
population to provide statistical distributions of 
25 motility and/or morphology. 

Typically, the image capture is performed using 
digital imaging means. The digital imaging means 
preferably provides a frame resolution or an effective 
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frame resolution of at least 0.5 x 10 6 pixels. The frame 
resolution or effective frame resolution may be of at 
least 10 6 pixels. Preferably, the frame resolution or 
effective frame resolution is at least 5 x 10 6 pixels. 
5 Preferably, the digital imaging means has a pixel 

size of 10 mm x 10 mm (or equivalent area for different 
shapes) or lower. For example, the pixel size may be 8 
mm x 8 mm or lower. Typically, the digital imaging means 
is used in combination with a microscope objective lens 

10 of at least x20 (preferably x40) magnification) . 

Typically, the rate of image capture for such a 
series of frames is at least 10 Hz. It may be at least 
20 Hz, more preferably at least 30 Hz. In the case of 
spermatozoa, the beat cross frequency is typically 10 Hz, 

15 so image capture rates at least 20 Hz are preferred. 

Preferably, the cell or cells of interest are 
spermatozoa, such as human spermatozoa. 

In a third aspect of the invention, there is 
provided a method of diagnosis including a method 

20 according to the first or second aspect and a step of 
diagnosis based on the determination of the morphology 
and motility of the population of cells in vitro (or ex 
vivo) . 

Preferably, the step of diagnosis is based on a 
25 value of the amount or relative amount of cells 

categorised as morphologically normal and having a 
motility at or above a threshold motility value. 
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In a fourth aspect, there is provided apparatus 
for determining the morphology and motility of a 
population of cells in vitro or ex vivo, the apparatus 
including : 

5 imaging means for capturing first and second 

frames of image data of said population and 
identifying a part or parts of the image data 
corresponding to a cell or cells of interest 
computation means for determining the 
10 morphology of the cell or cells of interest from 

the first and/or second frame and for determining 
the relative displacement, in the second frame 
compared to the first frame, of the cell or cells 
of interest . 

15 Preferred and/or optional features set out above 

may be applied independently or in any combination with 
this aspect of the invention. 

Preferably, the apparatus is for carrying out a 
method of any one of the first, second or third aspects. 
20 Preferably, the imaging means includes phase 

contrast optics. 

In a fifth aspect of the invention there is 
provided a computer system operatively configured to 
carry out the method of any one of the first, second or 
25 third aspects. 

In a sixth aspect of the invention there is 
provided computer programming code for operatively 
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configuring a computer system to carry out the method of 
any one of the first, second or third aspects. 

In a seventh aspect of the invention there is 
provided a data carrier having recorded on it computer 
5 programming code according to the sixth aspect . 

Preferred embodiments of the invention will now be 
described, by way of example, with reference to the 
accompanying drawings, in which: 

Fig. 1 shows a schematic view of an apparatus 
10 according to an embodiment of the invention. 

Fig. 2 shows a flow chart illustrating an overview 
of the functions performed by the apparatus of Fig. 1. 

Fig. 3 shows a flow chart illustrating an image 
capture sequence for use in an embodiment of the 
15 invention. 

Fig. 4 shows a flow chart illustrating an overview 
of the image analysis methodology for use in an 
embodiment of the invention. 

Fig. 5 shows a flow chart illustrating the 
20 morphological analysis methodology for Fig. 4. 

Fig. 6 shows a flow chart illustrating the 
tracking methodology for Fig. 4. 

Fig. 7 shows a frequency distribution of the 
length/width ratio of motile sperm using an embodiment of 
25 the present invention on live samples. 

Fig. 8 shows a comparison of high resolution 
imaging of live sperm cells. Fig. 8B is taken at a 
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higher spatial resolution than Fig. 8A for the same 
magnification . 

Fig. 9 shows a sample image taken from an 
apparatus according to an embodiment of the invention, 
5 illustrating the identification and tracking marking 
applied to the image. 

Fig. 10 shows another sample image taken from an 
apparatus according to an embodiment of the invention, 
illustrating the identification and tracking marking 
10 applied to the image. 

The present inventors assembled a CASA based upon 
existing microscopes and digital video cameras used in 
particle image velocimetry (PIV) , a technique used in 
aerodynamics and fluid mechanics (Green et <al 2 000) . 
15 Digital video images of live semen samples were recorded 
using the CASA apparatus. These samples were from a 
combination of fresh and frozen, donor and patient 
samples. Off-line analysis of the digital images was 
performed, and sperm cell motility and morphology data 
20 were successfully obtained from the images. Using the 

embodiment of the invention it was possible therefore to 
provide simultaneous morphology and motility analysis of 
a live semen sample. 

An apparatus 10 according to an embodiment of the 
25 invention is shown in Fig. 1. 

Optical microscope 12 is provided with phase 
contrast optics 14. A specimen chamber 16 is mounted 
within a temperature controlled enclosure 2 0 on a 
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motorized stage 18 on base 19. For human sperm, a 20 
micrometer chamber depth is required to conform with WHO 
guidelines . 

The apparatus has an image recording system for 
5 recording a sequence of images from" the microscope. In 

this embodiment, a monochrome, digital video camera 22 is 
attached to the microscope. Camera 22 is connected to a 
dedicated frame grabber 24. A computer 26, with a 
display and/or printing interface is connected to the 
10 microscope stage 18 . The computer is for image capture 
and analysis (including control of the microscope) and 
for running the software for the motility and morphology 
algorithms . 

A feature of the system is that the optical and 
15 camera system is able to record images of adequate 
spatial resolution for a sufficiently accurate 
morphological analysis. Furthermore, the camera has a 
high enough frame rate so that the kinematics of the 
moving objects may be resolved. This is explained in 
20 more detail below. 

The preferred minimum spatial resolution required 
by the camera and microscope is that to satisfy the 
Nyquist sampling theorem. For example, to resolve the 
morphological features of a human sperm cell a typical 
25 microscope with a x2 0 objective with a numerical aperture 
of 0.4 requires a camera with pixel size of 7.4 
micrometers square with a sensor resolution of 1000 x 
1000 pixels. Careful matching of the microscope and 
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camera in this way optimises the accuracy of the 
morphological measurements, and a less well matched set- 
up will compromise the system performance. For free 
moving cells in a fluid (such as live sperm in a semen 
5 sample) the depth of field of the microscope and camera 
system have to be as large as possible without 
compromising the spatial resolution. For the frame rate 
of the camera the Nyquist sampling theorem is also 
appropriate to use as a guideline, and for human sperm a 

10 camera frame rate of 3 0 Hertz is preferred to sample the 
spermatozoa kinematics correctly. 

The microscopes employed in the study were 
standard laboratory upright microscopes (e.g. Olympus 
BH12) fitted with phase contrast rings and x2 0 and x40 

15 objectives. The microscopes were fitted with C-mount 

adapters for attaching the video camera 22. One camera 
used was a Kodak Megaplus ES1.0, 8-bit monochrome digital 
video camera, which is a full frame camera with a lk x lk 
pixel CCD array and maximum framing rate of 30fps. For 

20 image recording a high-performance desktop PC running 

Windows 98 was used, and this was fitted with a National 
Instruments PCI -1424 digital video capture card and 
National Instruments PC-TIO-10 counter- timer card to 
control the camera frame rate. The system was programmed 

25 using LabVIEW , which provided a simple graphical user 

interface, and allowed the correct exposure and recording 
parameters to be set. The camera gain and shutter speed 
and the microscope illumination level were set to avoid 
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saturation of the images while providing as sharp an 
image of a sperm cell as possible. In this embodiment, 
up to 72 images could be captured for each digital video 
sample, and the LabVIEW system saved the digital images in 
5 uncompressed TIFF format. Additional images were taken 
using a Nikon D1X high resolution, digital colour stills 
camera. This camera has a CCD array of 3k x 2k pixel 
resolution with 8 -bit depth on each RGB channel. 

Digital video recordings were made of semen 

10 samples provided for analysis by 11 men undergoing 

infertility investigations in addition to 8 fresh or 
frozen samples provided by research donors attending the 
donor insemination programme. These samples were each 
analysed for sperm concentration, motility and morphology 

15 using the standard manual (WHO, 1999) techniques. In 

addition, the samples were then observed using the above- 
described CASA apparatus. A total of 6 to 8 full fields 
of view of 2.4 seconds duration at 30fps and shutter 
speed 5ms were captured for later analysis. Images were 

20 taken for x2 0 and x4 0 magnification. Spermatozoa were 

observed in a 2 0/xm depth Microcell chambers to allow the 
spermatozoa the ability to display their full range of 
motion characteristics. For some of the semen samples 
digital still images were taken using the Nikon camera 

25 set to a sensitivity of ISO800 and a shutter speed of 
1/100 s. 
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As shown in Fig. 2, the overview of the process is 
image capture 202, followed by image analysis 204 and 
then data analysis 206, followed by data presentation 208. 

With reference to Fig. 3, for each test, a semen 
5 sample is initially placed in a chamber and the chamber 

placed in the microscope. The camera is focussed at step 
302, using the microscope optics, on any user defined 
focal plane within the chamber, and microscope and 
illumination and camera exposure levels are set at step 

10 304. Image capture may then take place. A suitable 
image capture rate is then set (for example 3 0Hz as 
discussed above) at step 306 and the duration of image 
capture is set to comply with WHO guidelines (a minimum 
duration of least 0.8 seconds is required by those 

15 guidelines) . After one field is captured (step 308) the 
computer moves the microscope stage (step 310) to a new 
field and the process is repeated, typically for six 
fields. The image data for each frame for each field is 
stored on the computer. 

20 The computer system then executes the image 

analysis methodology which comprises morphology and 
motility analysis processes. The software for carrying 
out the image analysis was programmed on a PC using 
MATLAB. An overview of the process is shown in Fig. 4, 

25 showing an object identification stage 402 and an object 
tracking stage 404. 

Fig. 5 illustrates in more detail the steps taken 
during the object identification stage 402. 
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In order to simultaneously measure motility and 
morphology of a spermatozoon in a confident manner the 
image data should first be split into object (essential) 
data and background (non-essential) data. Every 
5 spermatozoon that exists within the image depth of field 
should be found, measured and then followed through an 
image sequence. To the human eye the most distinctive 
characteristic of a spermatozoon is the head and it was 
therefore appropriate to use this feature for automated 

10 spermatozoon detection. There are very distinguishing 
morphological aspects of a head that allow it to be 
consistently filtered from similar sized and orientated 
structures in the sample (e.g. germ cells or leucocytes) . 
In particular the area between the acrosome and the 

15 midpiece is distinctive both in contrast and in shape and 
it is well isolated by the head membrane, preventing 
illumination profile contamination even when other cells 
are contiguous to the spermatozoon perimeter. Additional 
or alternative recognisable features of a sperm cell are: 

20 a nominal area; a nominal length to width ratio; nominal 
intensity profile along its major axis. These attributes 
make for a confident, repeatable morphological 
characteristic for a motile spermatozoon. It is then a 
straightforward step to build a morphological filtering 

25 routine to extract these structures from the image plane. 
Such a routine will be arrived at in a straightforward 
manner by a person skilled in the art. 
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The first frame in the recorded sequence of a 
given field is selected. Fig. 5 shows the steps taken. 
Possible object data of interest on this frame are 
identified by their change of gradient on the grey level 
5 digital image (step 502) . Perimeters of each object are 
located, and clumped objects have their perimeters 
located using a skeletal algorithm so that each potential 
cell structure is isolated (step 504) . Cells of interest 
are then filtered out from this set of object data (step 

10 506) as follows. A weighted sum of the characteristic 
features for each object in the sample is then used to 
identify sperm cells in the image. In step 508, the 
filtered data are then re-analysed on a cell-by-cell 
basis to extract detailed cell morphology data (for 

15 example length, width, area, shape) . The next frame of 
the same sequence is then selected (step 510) , and the 
above analysis is repeated until the last frame of the 
recorded sequence has been analysed. 

An important factor in this embodiment is the 

20 application of image processing algorithms in an order 

that exposes the object characteristics of interest. The 
skilled person will realise that image processing (and 
especially morphological assessment algorithms) can yield 
the same result using many different techniques. The 

25 techniques described in broad terms here may therefore be 
replaced by other, equivalent techniques. 

Sequential identification of the individual 
structures in the sample for each frame is performed and 
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a decision is made as to whether it is important. This 
can be done because when imaged correctly spermatozoa 
have very particular characteristics (illumination 
profile, shape and size) that are not specifically shared 
5 with any other extra-cellular material extant in the 
sample . 

The illumination profile of an object is the 
intensity profile on the image plane that describes the 
spermatozoon. The intensity distribution of the nucleus 

10 part of the sperm head is very distinctive and a simple 

morphological filter used to identify this artefact. The 
artefact has a centre point of maximum intensity with a 
nearly axis -symmetric domical intensity profile, similar 
to a bell curve. The acrosome shape and acrosome 

15 intensity distribution are also repeatable and 

distinguishable and can be used to identify the sperm 
head, particularly when a high spatial resolution image 
is obtained. 

The inventors consider that the illumination 

20 footprint is the best initial filter for identifying the 
sperm since this places no restrictions on the physical 
shape or physical size of the objects to be measured. It 
also works when other cells are contiguous with the head 
perimeter. This is a more rigorous procedure since it 

25 means that all spermatozoa are measured irrespective of 
distortion or irregularities, yielding a better 
statistical measurement . Previous CASA systems are only 
capable of identifying sperm that are of a particular 
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size and shape, and these limits must be controlled very 
closely for successful operation. 

Typically, cameras will always generate dark 
current (or noise) and so it is to be expected that not 
5 all illumination profiles identified using the initial 
filter described above are actually the heads of 
spermatozoa. Therefore a shape filter is used to extract 
the perimeter of the objects located above to see, for 
each object, if it is contained in one body (that is the 
10 perimeter of the structure contains an acrosome and a 

nucleus part). The shape should also take on the generic 
features of a sperm head (a pointed head with orbicular 
body) , obtained once again through morphological 
filtering . 

15 The final filter routine performed measures the 

size of the object data. This is much less important 
than the other characteristics but is used in the 
weighted voting procedure to decide whether the object 
identified is a sperm cell or not. For human sperm the 

20 length and width of the head, midpiece (between head and 
tail) and principle piece (tail) are well known from 
previous research. The present system can then measure 
these features and judge their similarity. The advantage 
is that this final filter can be much more relaxed than 

25 the size filtering imposed by other CASA systems . 

On the basis of the results from each filter, it 
is possible to make a confident appraisal of each 
individual object using a weighted voting procedure. In 
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the event that the voting procedure does not provide a 
conclusive decision for a particular object, then the 
object is checked using an algorithm for identifying tail 
protrusions and/or object movement. 
5 The objects that are not categorized as 

spermatozoa may still be important and some 
classification as to their nature is pursued. Therefore 
the system measures each remaining structure and logs its 

* 

pertinent characteristics. Immature germ cells are 

10 automatically identified by the system (since these are 
the most frequent of residual structures) and leukocytes 
are identified also. 

Usually the detailed morphological information for 
a cell is taken from the best in-focus picture of the 

15 cell. Once the detailed morphological analysis has been 
performed for each cell of interest in the frame sequence 
of image data, the motility analysis may then proceed 
using the morphological data obtained. Fig 6 shows the 
steps taken during the motility analysis. 

20 The first image pair (the first and second frames 

of image data) in the sequence is used to make an initial 
projection of each cell track based upon known cell 
morphology and orientation and a simple tracking scheme, 
for example a nearest neighbour method. Then any 

25 existing cell tracks are extended into the next frame 

using the available morphology and cell track information. 
Any new tracks appearing in any two successive frames are 
started off and continued appropriately. This is 
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completed for all frames, and morphological and kinematic 
data are used to close any broken tracks where the cell 
might have moved out of focus between frames. The frames 
are then re-examined to identify non-motile cells and 
5 other non-motile objects, which are then classified 

accordingly. Each individual cell track is then examined 
and all useful morphological data along the track are 
used to build up the most complete morphological 
characterization of that cell. Finally, referring back 

10 to Fig. 2 (steps 206 and 208), the system analyses the 
cell track and morphological data and provides a 
representative set of sample based statistics for the 
analysis regarding cell morphology and motility, for 
example the number or proportion of morphologically 

15 normal, motile cells in the analysis. 

Looking at the motility analysis in more detail, 
an algorithm was constructed that would follow each 
spermatozoon through the object data sequence. A known 
straightforward tracking methodology is to track the 

20 nearest neighbour between fields/ frames. A nearest 

neighbour analysis is what existing CASAs use. However 
such a nearest neighbour scheme is not appropriate due to 
sperm collisions, which would lead to broken tracks and 
other anomalies that skew the statistics unless accounted 

25 for. Instead, nearest neighbour analysis provides the 
basis for the present methodology. 

The methodology employed for motility measurement 
was to combine the nearest neighbour analysis with the 
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high quality morphological data obtained in step 402. 
The tracking technique matches kinematic properties of a 
moving spermatozoon (i.e. its velocity and trajectory) 
and also its morphological qualities, already measured 
5 and stored when establishing object data. There are 

significant benefits to this approach when the sample is 
highly populated and collisions are commonplace. By 
using the morphological properties of the head it was 
possible to distinguish between a number of spermatozoa 

10 even in close proximity, thus making it a successful 
tracking algorithm even when collisions and crossings 
were prevalent. Since the head shapes were measured in 
each frame, the morphological algorithm could then seek 
out the best profile to measure the shape characteristics 

15 with respect to focus and attitude of the sperm cell. 

Looking at Fig. 6, this drawing shows a flow 
diagram layout of the object tracking algorithm for step 
404. A frame is selected at step 602 and routine 604 is 
carried out for that image data. For a cell of interest 

20 in the frame, the morphological data for that cell is 
uploaded (step 606) . The purpose of the tracking 
algorithm may be thought of simply as joining the dots 
between frames. The movement of the sperm cell is 
predicted in step 608 . Based on the detailed 

25 morphological data captured from one frame, the 

orientation and shape of the sperm head in that frame is 
known. Thus it is possible to reassess the prediction of 
step 608 to more accurately project where the spermatozoa 
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is going to travel between frames (step 610) , while it is 
already known what it actually looks like (head 
perimeter-shape, head area, head length, head width, 
acrosome area, DNA area etc.) . Finally, for that cell in 
5 that frame, a track decision is made (step 612) to assess 
the motion of the cell from the previous frame. Note 
that as the track gets longer the kinematics of the 
spermatozoon are better estimated, making further 
tracking easier. Steps 606-612 are repeated (step 614) 

10 in the frame. Next, the routine is repeated for each 
frame of the sequence (616) . 

From an optical perspective the depth of field of 
the microscope causes some spermatozoa to come in and out 
of focus. In preferred embodiments there are in-built 

15 procedures to check that if a spermatozoa does 

'disappear' then the residual structures are checked 
(where the data would reside) and the track is re- 
connected. Throughout a complete track all the required 
kinematic data can be extracted and the morphological 

20 data can be measured also. 

There are known techniques that one skilled in the 
art of image analysis processing will be able to use to 
provide specific algorithms for suitable image analysis. 
For example, thresholding with filters may be used to 

25 seek out specific spatial and illumination shape profiles. 

The above -described image analysis methodology was 
applied to the digital image recordings of donor and 
patient semen samples collected at the Andrology 
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Laboratory in Sheffield, UK. In this example, the Kodak 
ES1.0 camera was used. Its spatial resolution was 
adequate to just distinguish between the individual 
profiles of spermatozoa heads, thus allowing the tracking 
5 algorithm to operate. It was seen that the measurement 
errors caused by camera digitisation affect the nominal 
head width and head length by ±4.8% and ±7.5% error 
respectively. 

Fig. 7 shows normalized frequency distributions of 

10 length/width ratio for progressively motile sperm having 
an average speed of greater than 5 micrometers per second 
for samples from a range of donors and patients. From 
this graph there are clear variations of the frequency 
distributions of the head length/width ratio of the 

15 individual samples, and the camera measurement error is 

not sufficiently large to make this difference irrelevant. 
The data was consistent with WHO (1999) , although there 
is variation between individuals giving further merit to 
the proposition that the ability to make simultaneous 

20 motility and morphology measurements will be clinically 

useful. A note of interest is that the semen sample from 
Patient 1 (Fig 7) contained a large number of immature 
germ cells, which appear morphologically as distinctive 
circles and morphological filters were written to detect 

25 these. Since the presence of germ cells in an ejaculate 
is a marker of testicular dysfunction, the ability to 
detect these at the same time that motility and 
morphology is being measured is a distinct advantage. 
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Fig. 8 shows a comparison of high resolution 
imaging of live sperm cells. Fig. 8B (taken using Nikon 
D1X camera) has at a higher spatial resolution than Fig. 
8A (taken using Kodak Megaplus ES1.0 camera) but at the 
5 same magnification. The pixellation in Fig. 8A is much 
clearer than in Fig. 8B, the definition of the shape of 
the head of the sperm in Fig. 8B being much clearer in 
Fig. 8B than in Fig. 8A. 

Figs. 9 and 10 show overlaid sample output images 

10 from the software and digital camera. 

Fig. 9 illustrates the identification and tracking 
marking applied to the image. Only the tracks of motile 
sperm are shown (for clarity of presentation) and these 
are displayed as solid lines. Note that the output from 

15 the apparatus uses false colour to identify tracks of 

cells with different morphology scores, but that cannot 
be reproduced here . Points along each track where the 
sperm cell has presented a good enough image to obtain 
morphology data are represented by circles, with the 

20 quality of that morphology data represented by the false 
colours mentioned above. It may be seen that, along any 
particular track, each individual sperm cell sometimes 
presents a good profile for morphological measurements, 
and at other times (say as a result of swimming out of 

25 focus, or of poor orientation relative to the camera) 
presents a less good opportunity for gathering 
morphological data. An example of this is shown for track 
a) of Fig. 9. 
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By collecting morphology data at several points 
along a track,, a more complete morphological picture of 
each individual cell can be obtained. Fig. 9 also shows 
a good example of how the algorithm uses morphological 
5 data to differentiate between the tracks of two (or more) 
individual sperm cells which cross paths, move close to 
one another or collide. This can be seen at point b) in 
the Fig. 9, where two sperm tracks run almost alongside 
each other, but also cross regularly. Because each cell 

10 has individual morphology, then the algorithm can 

separate the two tracks, as a direct consequence of 
performing morphological measurements and motility 
measurements on the same live sample. This process was 
not previously possible using existing CASA machines. 

15 In Fig. 10, points c) and d) also show the 

algorithm differentiating between tracks that cross. 
Also on this figure is an example of a long sperm track 
(track labelled d) ) where a great deal of morphology data 
is available, and another track (track f ) ) where the 

20 sperm has moved much less distance. This shows that the 
present system can supply quantitative data on motility 
levels (and corresponding morphologies) of individual 
cells. Point e) in Fig. 10 is also of interest, in that 
it shows a successfully tracked sperm cell which has been 

25 slightly out of focus, and therefore has presented 

relatively poor morphology data, except for a few points 
along the track. The important feature here is that the 
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tracking algorithm continues to operate even when 
morphology data is poor. 

The above embodiments have been described by way 
of example only. Modifications of these embodiments, 
5 further embodiments and modifications thereof will be 

apparent to the skilled person on reading this disclosure 
and are within the scope of the invention. 
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